Papers with salience evaluation
Commonsense Knowledge Salience Evaluation with a Benchmark Dataset in E-commerce (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models rank statements solely by confidence scores, and there is no information about which ones are salient from a human perspective. |
| Approach: | They propose a task where a model is required to learn whether a triple is salient . they propose supervised salience evaluation using a new Benchmark dataset . |
| Outcome: | The proposed task is based on a new Benchmark dataset of salience evaluation in e-commerce . it shows that saliency evaluation is hard, where models perform poorly on evaluation set . |